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Background of the Invention 

Field of the Invention 

The field of the invention relates to information retrieval systems. More 
particularly, the field of the inventions relates to generating index information for data 
objects. 



Description of the Related Technology 

Information retrieval (IR) systems index documents by searching for keywords 

10 that are contained within the documents. Typically, the searches are not performed on 
the documents themselves. Instead, words are extracted from the document and are then 
indexed in separate data structures optimized for searching. 

However, secure documents, such as documents that are protected by digital 
rights management (DRM) software, present a special problem for IR systems. 

1 5 Traditionally, IR systems rely upon having fiiU access to the contents of the document 

to prepare the index information for the document. For example, IR systems that index 
HyperText Markup Language (HTML) documents on the Internet typically open the 
HTML documents via its Uniform Resource Locator (URL), then download, parse, and 
index the entire document. 

20 Secure software, however, does not permit this kind of unrestricted access. 

Access is restricted to those applications that are both authorized and trusted by the 
secure soft^^are. For security concems, all other applications are prevented from 
accessing the protected document. 

One way to solve this problem is to retrofit all pre-existing IR systems so that 

25 they are "rights enabled." This solution permits IR systems to communicate directly 

with secure software to obtain the document source. However, this approach makes a 
number of unrealistic assumptions, including: (i) that it is possible to retrofit legacy IR 
systems such that they would comply with the secure software's security requirements; 
(ii) that all secure system providers would be willing or able to make the necessary 

30 changes in a timely manner; and (iii) that it is possible to establish the necessary trust 
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relationships between every secure provider, copyright holder, and ER system provider. 
This approach has attendant flaws and there is a need for a better solution. 

Another problem with preparing index information for IR systems is that each 
IR system has different indexing algorithms for organizing and storing information. ER 
5 systems often analyze the header of the electronic document when selecting the index 

information for the electronic document. The header includes meta-information 
regarding the content of document. However, not all of the IR systems retrieve the 
same keywords from the electronic document when selecting the index information. 
For example, some ER systems remove duplicative words from the metatag information, 

10 while others do not. Furthermore, for example, some IR system recognize phrases, 
while others do not. Accordingly, it is difficult to customize index information that is 
ideally suited for use with more than one IR system. 

Thus, there is a need for a system for providing index information to IR systems. 
The system should be able to provide information to the IR systems that is almost as 

15 usable as the original. Preferably, the system should not require the modification of any 

legacy IR systems. Furthermore, it should be difficult to reconstruct the original 
document source (or any reasonable facsimile thereof) from the provided index 
information. Furthermore, the system should be able to automatically customize the 
index information regarding an electronic document, on an IR system-by-IR system 

20 basis. 

Summary of the Invention 
In one embodiment of the invention, a method of generating index information 
for audiovisual objects, comprising converting at least a portion of an audiovisual object 
25 into index information, and obfiiscating at least a portion of the index information so 

that the intelligibility of the contents of the index information is reduced. 

In yet another embodiment of the invention, a method of generating index 
information for graphical or audio objects, the method comprising reading index 
information that is associated with a graphical or audio object, obfiiscating at least a 
30 portion of the index information so that the intelligibility of the index information is 
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reduced, and transmitting the obfuscated index information to an information retrieval 
system. 

In yet another embodiment of the invention, a method of generating index 
information for graphical or audio objects, comprising reading index information that is 
5 associated with a graphical or audio object, and dynamically generating an electronic 

document based at least in part upon the contents of the index information. 

hi yet another embodiment of the invention, a method of generating index 
information for graphical or audio objects, comprising converting at least a portion of a 
graphical or audio object into index information, and dynamically generating an 
10 electronic document based at least in part upon the contents of the index information. 

In yet another embodiment of the invention, a method of generating index 
information for a data object, the method comprising converting at least a portion of the 
data object from a first natural language to a second natural language, and obfuscating at 
least a portion of the converted portions of the data object so that the intelligibility of 
1 5 the converted portions of the data object are reduced. 

In yet another embodiment of the invention, a method of generating index 
information for a data object, the method comprising converting at least a portion of the 
data object from a first language to a second language, and dynamically generating an 
electronic document based at least in part upon the contents of the converted portions of 
20 the data object. 

Brief Description of the Drawings 
Figure 1 is a block diagram illustrating one network configuration that 
comprises a client computer and a server computer that are connected via a network. 
25 Figure 2 is a data flow diagram illustrating in further detail the communication 

between the client computer and the server computer of Figure 1 . 

Figure 3 is a block diagram illustrating in further detail the software components 
of the server computer of Figure 2. 

Figure 4 is a block diagram illustrating the components of a user database that is 
30 maintained by the server computer of Figure 1 . 
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Figure 5 is a top level flowchart illustrating a process for preparing a response to 
a request for an electronic resource that is maintained by the server computer of Figure 
1. 

Figures 6 and 7 are collectively a flowchart illustrating in further detail the states 
5 of Figure 5 whereby the server computer prepares a response to the request for the 

electronic resource. 

Figure 8 is a block diagram illustrating one of the data objects shovra in Figure 2 
being partitioned into multiple sections, each of the sections comprising a chapter in a 
book. 

10 Figure 9 is a representational block diagram illustrating an exemplary screen 

display that is transmitted to the client computer (Figure 1) from the server computer 
(Figure 1) in response to a request for an electronic resource from the client computer. 
:^ Figure 10 is a flowchart illustrating an obfliscation process that is performed by 

ill the server computer of Figure 2 with respect to index information that is associated with 

15 one of the data objects of Figure 2. 

''"^ Figures 11 and 12 are collectively a flowchart illustrating in further detail a 

|f= process for dynamically preparing the index information for an electronic document in 

13 response to a request for a network resource. 

Figure 13 is a block diagram illustrating the contents of an exemplary data 
3 20 object of Figure 2. 

Figure 14 is a block diagram illustrating a set of index information that is based 
upon the exemplary data object shown in Figure 13. 

Figure 15 is a block diagram illustrating the state of the index information of 
Figure 14 subsequent to one or more reserved words being added to the index 
25 information. 

Figure 16 is a block diagram illustrating the state of the index information of 
Figure 15 subsequent to the index information being randomized. 

Figure 17 is a block diagram illustrating an exemplary electronic document that 
is created by the server computer of Figure 1 for transmission to the client computer of 
30 Figxire 1. 



-5- 




Detailed Description of Embodiments of the Invention 
The following detailed description is directed to certain specific embodiments of 
the invention. However, the invention can be embodied in a multitude of different ways 
as defined and covered by the claims. 

5 

System Overview 

Referring to Figure 1, an exemplary network configuration 100 will be 
described. A user 102 communicates with a computing environment which may include 
multiple server computers 108 or single server computer 110 in a client/server 
10 relationship on a computer network 116. In a client/server environment, each of the 
server computers 108, 110 includes a server program which communicates with a client 
computer 115. 

The server computers 108, 110, and the client computer 115 may each have any 
conventional general purpose single- or multi-chip microprocessor such as a Pentium® 

15 processor, a Pentium® Pro processor, a 8051 processor, a MIPS® processor, a Power 

PC® processor, or an ALPHA® processor. In addition, the microprocessor may be any 
conventional special purpose microprocessor such as a digital signal processor or a 
graphics processor. Furthermore, the server computers 108, 110 and the client computer 
115 may be desktop, server, portable, hand-held, set-top, or any other desired type of 

20 configuration. Furthermore, the server computers 108, 110 and the client computer 115 

each may be used in connection with various operating systems such as: UNIX, 
LINUX, Disk Operating System (DOS), Vx Works, PalmOS, OS/2, Windows 3.X, 
Windows 95, Windows 98, and Windows NT. 

The server computers 108, 110, and the client computer 115 may each include a 

25 network terminal equipped with a video display, keyboard and pointing device. In one 

embodiment of network configuration 100, the client computer 115 includes a network 
browser 120 that is used to access the server computer 110. In one embodiment of the 
invention, the network browser 120 is the Internet Explorer, licensed by Microsoft Inc. 
of Redmond, Washington. 

30 The user 102 at the computer 115 may utilize the browser 120 to remotely 

access the server program using a keyboard and/or pointing device and a visual display, 
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such as a monitor 118. It is noted that although only one cUent computer 1 15 is shown 
in Figure 1, the network configuration 100 can include hundreds of thousands of client 
computers and upwards. 

The network 116 may include any type of electronically connected group of 
5 computers including, for instance, the following networks: a virtual private network, a 
public Intemet, a private Internet, a secure Internet, a private network, a public network, a 
value-added network, an intranet, and the like. In addition, the connectivity to the 
network may be, for example, remote modem, Ethernet (IEEE 802.3), Token Ring (IEEE 
802.5), Fiber Distributed Datalink Interface (FDDI) or Asynchronous Transfer Mode 
10 (ATM). The network 116 may connect to the client computer 1 15, for example, by use 
of a modem or by use of a network interface card that resides in the client computer 
115. 

The server computers 108 may be connected via a wide area network 106 to a 
network gateway 104, which provides access to the wide area network 106 via a high- 

15 speed, dedicated data circuit. 

Devices, other than the hardware configurations described above, may be used to 
communicate with the server computers 108, 110. If the server computers 108, 110 are 
equipped with voice recognition or DTMF hardware, the user 102 can communicate 
with the server programs by use of a telephone 124. Other connection devices for 

20 communicating with the server computers 108, 110 include a portable personal 
computer 126 with a modem or wireless connection interface, a cable interface device 
128 connected to a visual display 130, or a satellite dish 132 connected to a satellite 
receiver 134 and a television 136. For convenience of description, each of the above 
hardware configurations are included within the definition of the client computer 115. 

25 Other ways of allowing communication between the user 102 and the server computers 

108, 1 10 are envisioned. 

Further, it is noted the server computers 108, 110 and the client computer 115, 
may not necessarily be located in the same room, building or complex. In fact, the 
server computers 108, 110 and the client computer 115 could each be located in 

30 different states or coimtries. 
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Figure 2 is a block diagram illustrating in further detail selected aspects of 
Figure 1 . Figure 2 illustrates the communication between the communication between 
the client computer 1 15, a plurality of information retrieval ("ER") systems 208A-208M, 
and the server computers 108, 110. Each of the IR systems 208A-208M may be 
5 embodied in any of the hardware configurations set forth above with respect to the 

server computer 110 or the cUent computer 115. Figure 2 illustrates that the client 
computer 1 15 is connected to the server 110 and the plurality of IR systems 208A-208M 
via the network 116. It is noted that although only three IR systems 208A-208M are 
shown in Figure 2, the client computer 115 and the server computer 110 can be 

10 connected to a large number, e.g., hundreds or more, of IR systems. For convenience of 
description, the remainder of the discussion will refer only to the server computer 110 
when referring to the server computers 108, 110. However, it is to be appreciated that 
the description of the operation of server computer 110, equally applies to the operation 
of the server computers 108. Optionally, the server computer 110 and the IR systems 

15 208A-208M, or selected ones thereof, may be integrated on a single computer platform. 

The IR systems 208A-208M can include one or more proprietary or commercial 
search engines, including only by way of example: AOL Search located at 
<http:\\search.aoLcom\>, ALTAVISTA located at <http:\\www.altavista.com\>, 
ASKJEEVES located at <http:\\www.askjeeves.com\>, Direct Hit located at 

20 <http:\\www.directhit.com\>. Excite located at <http:\\www.excite.com\>, Hot Bot 
located at <http:\\www.hotbot.com\>, Inktomi located at <http:\\www.inktomi.com\>, 
MSN Search located at <http:\\search.msn.com\>, Netscape located at 
<http:\\search.netscape.com\>, Northem Light located at 

<http:\\www.northemlight.com\>, and Yahoo located at <http:\\www.yahoo.com\>. 

25 The IR systems 208A-208M can also include a system licensed for private use and 

hosted within an intranet or an extranet. As an example, such an IR system can include 
Ultraseek licensed by InfoSeek of Sunny Vale, CA. 

To publish information regarding a plurality of data objects 216A-216N, the 
server computer 110 associates each of the data objects 216A-216N with a selected 

30 URL, and then the server computer 110 notifies the IR systems 208A-208M of each of 
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the selected URLs. For convenience of description, the data object that is associated 
with a selected URL is referred to below as the "source data object." 

Selected ones of the IR systems 208A-208M use a software program called a 
"spider" (not shown) to survey the electronic resources that are stored by the computers 
5 connected to the network 116, such as the server computer 110. Electronic resources 
can comprise prepared electronic documents, or, altematively, dynamically prepared 
electronic documents which are the output of scripts of the server computer 1 10. In one 
embodiment, the spiders are programmed to visit a server that has been identified by a 
server administrator as being new or updated. The spider follows all of the hypertext 

10 links in each of the electronic documents of the server until all the electronic documents 
have been read. An indexing program (not shown) reads the surveyed electronic 
documents and creates an index database based on the words contained in each of the 
surveyed electronic documents. In another embodiment of the invention, the server 
computer 110 provides a list of electronic documents in the server computer 110 that 

1 5 should be indexed by the ER system. 

In one embodiment, the server computer 110 knows the indexing characteristics 
of the IR systems 208A-208M. In response to a request for a selected electronic 
resource, e.g., an electronic document, the server computer 110 dynamically generates 
an electronic document that comprises the index information for the source data object 

20 that is associated with the request. As defined herein, the term "dynamically generates" 
comprises either (i) preparing in real-time an electronic document or (ii) transmitting a 
pre-prepared electronic document that is associated with the URL and that is customized 
particularly for a selected requestor. 

In customizing the index information, the server computer 110 attempts to 

25 maximize the odds that a user will find the index information for the source data object 

within the IR system. The index information for the source data object may optionally 
be obfuscated such that the index information may not be readily used for purposes 
other than indexing. Furthermore, in one embodiment of the invention, the server 
computer 1 10 maintains a database 210 that stores metadata for each of the data objects 

30 21 6A-2 1 6N. By analyzing the metadata in the database 2 1 0, the server 2 1 0 can identify 

words that are not in the source data object, but if included in the index information for 
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the source data object would be relevant, thereby increasing the odds that a user will 
find the source data object. 

Once the electronic document has been indexed by the IR systems 208A-208M, 
the user 102 (Figure 1) may supply search terms to one or more of the IR systems 
5 208A-208M to receive a list of relevant documents. In one embodiment, one or more of 

the IR systems 208A-208M contain index information for documents that are 
maintained by servers other than the server computer 110. 

When the user 102 enters a query using a selected one of the IR systems 208 A- 
208M, the query is checked against the IR system's index database. The best matches 

10 are then returned to the user 102 as "hits", i.e., possibly relevant electronic documents 
based upon the search words in the query. The selected ER system displays for each of 
the hits at least some of the index information that is associated with each of the hits and 
an address, e.g., URL, of the hits. In one embodiment of the invention, the displayed 
addresses of the identified electronic document are selectable by using one or more 

15 input devices, such as a mouse. By selecting an address, the browser 120 automatically 

requests an electronic document fi"om the selected address. 

Upon receiving the request, the server computer 110 determines whether the 
requester is the client computer 115 or one of the ER systems 208A-208M. If the 
request is fi-om one of the IR systems, as discussed above, the server computer 110 

20 dynamically generates an electronic document that includes the index information for 

the source data object of the network request. 

However if the server computer 110 determines that the requester is the client 
computer 115, the server computer 110 determines whether the client computer 115 is 
authorized to access the source data object. If the client computer 115 is authorized to 

25 access the source data object, the server computer 110 transmits the source data object 

to the client computer 115. However, if the client computer 115 is not authorized to 
access the source data object, the server computer 110 generates an electronic document 
that informs the user of which steps the user must perform to obtain access to the source 
data object. 

30 The electronic request fi'om the client computer 115 can correspond to one of 

any number of network protocols. In one embodiment of the invention, the electronic 
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request comprises a Hypertext Transfer Protocol (HTTP) request. However, it is to be 
appreciated that other types of network communication protocols may be used. 

HTTP allows the client 115, the server computer 110, and IR systems 208 A- 
208M to communicate with each other. HTTP defines how messages are formatted and 
5 transmitted, and what actions the server computer 110, the client computer 115, and the 

IR systems 208A-208M should take in response to various commands. According to 
HTTP, the client computer 115 can request a network resource fi-om the server 
computer 110. For example, when a URL is selected fi"om in the browser 120 (Figure 
1), the browser 120 sends an GET command to the server that is hosting the URL, 
10 directing the server to fetch and transmit the electronic resources that are associated 
with the URL. 

It is noted that all HTTP transactions follow the same general format. Each 
client request and server response has three parts: a request or response line, a header 
section, and the entity body. The client initiates a transaction as follows. First, the 

15 client computer sends a document request by specifying an HTTP command called a 
"method", e.g., GET, POST, followed by a resource address, and an HTTP version 
number. Next, the client sends optional header information to inform the server of its 
configuration and the document formats it will accept. The header information can 
include the name and version number as well as specifying resource preferences. For 

20 example, and exemplary GET transaction is as follows: 

GET /index.html HTTP/1 .0 
Connection: Keep- Alive 
User-Agent: Mozilla/2.02Gold (WinNT; I) 
Host: www.MediaDNA.com 
25 Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, */* 

It is noted that the "User- Agent" portion of the GET transaction describes the name or 

identifier of the requester. The body portion of a GET transaction is typically empty. 

According to the present invention, in response to a HTTP request for an electronic 

resource that is associated a selected URL, the server computer 110 transmits an 

30 electronic document having index or other descriptive information regarding the source 

data object that is associated with the request, or, alternatively, one of the source data 

object itself, depending on the identity and authorization of the requester. 
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In one embodiment of the invention, the electronic document includes a header 
and a body. The header and the body for the electronic document are dynamically 
created and customized in response to an electronic request for an electronic resource by 
the client computer 115 and/or one of the IR systems 208A-208M. The header 
5 describes properties of the document such as title, document toolbar, scripts and meta 

information. The body defines the page that is displayed to the user once the electronic 
document is received by the requester. 

For example, assuming the electronic document is an HTML document, the 
header can include the following elements: BASE, LINK, META, and TITLE. The 

10 BASE element defines an absolute URL that resolves relative URLs within the 
document. The LINK element defines relationships between the document and other 
documents. The LINK element can be used to create tool bars, link to a style sheet, a 
script, or a printable version of the document and embed authorship details. The META 
element includes information about the document not defined by other elements. The 

15 META element supplies generic meta information using name/value pairs. The TITLE 
element is displayed in the window title. As is discussed in further detail below, the 
server computer 110, depending on the embodiment, customizes one or more elements 
of the header and body. 

The data objects 216A-216N can be of any arbitrary format and can contain any 

20 type of data. For example, the data objects 216A-216N can include: an electronic 

document according to any open or proprietary format, eg., HTML, PDF, PostScript, 
rich text format, structured database formats, SGML, TeX, TrueType, XHTML, XML, 
XSL, Cascading Style Sheets, LaTeX, MuTeX, ASCII, EBCDIC, AVI. Furthermore, 
for example, the content of the data objects 216A-216N can include: a music file, e.g., 

25 MPS or MIDI, a multimedia file, a streaming media file, a bitmap image, configuration 

files, account information, an executable image, or a digital rights management (DRM) 
object. 

Figure 3 is a block diagram illustrating one embodiment of the server computer 
110 (Figure 1). The server computer 110 includes a number of modules to prepare a 
30 response to request, fi-om either the client computer 115 or one of the IR systems 
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208A-208M, for one of the electronic resources that is maintained by the server 
computer 110. 

In one embodiment of the invention, the server computer 110 includes a main 
engine 204 which maintains control over the processes within the server computer 110. 
5 The main engine 204 is in communication with a number of modules including a server 

interface module 218, an obfuscator module 220, a document generator module 222, an 
IR system database 224, format templates module 226, a user database 228, a thesaurus 
module 232, a stem word extractor module 236, a semantic network module 240, a 
pattem recognition module 245 being able to generate machine readable tokens that 

10 represent patterns in audiovisual data objects, and a keyword extractor module 244. 

As can be appreciated by one of ordinary skill in the art, each of the foregoing 
modules may comprise various sub-routines, procedures, definitional statements, and 
macros. Each of the foregoing modules are typically separately compiled and linked into 
a single executable program. Therefore, the following description of each of the foregoing 

15 modules is used for convenience to describe the functionality of the server computer 110. 

Thus, the processes that are undergone by selected ones of the modules may be arbitrarily 
redistributed to one of the other modules, combined together in a single module, made 
available in a shareable dynamic link library, or partitioned in any other logical way. 

The foregoing modules may be written in any programming language such as C, 

20 C-H-, BASIC, Pascal, Java, and FORTRAN and ran under the well-known operating 

system. C, C-H-, BASIC, Pascal, Java, and FORTRAN are industry standard 
programming languages for which many commercial compilers can be used to create 
executable code. 

The server interface module 218 is responsible for initially receiving a network 
25 request fi-om the client computer 115 and/or the IR systems 208A-208M and forwarding 

the request to the main engine 204. The document generator module 222 is responsible 
for dynamically generating an electronic document that comprises the index information 
for a respective one of the data objects 216A-216N. The obfuscator module 220 
obfuscates the contents of selected ones of the data objects 216A-216N in response to a 
30 request fi-om the main engine 204. The format templates module 226 maintains a 
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plurality of templates that define the layout of one or more of the data objects 216A- 



The JR system database 224 maintains the indexing characteristics of one or 
more IR systems. For example, the IR system database 224 includes information as to 
whether an IR system performs stemming, recognizes the case of keywords, recognizes 
duplicative words, and the number of words that are used by the JR system when 
indexing the electronic resource. In one embodiment of the invention, the indexing 
characteristics of the IR system is manually entered into the IR system database 224 via 
a system administrator at the server computer 1 10 in response to prompts by the server 
computer 110. In another embodiment of the invention, each of the IR systems 
automatically provide their indexing characteristic information based upon a request for 
such information. In yet another embodiment of the invention, each of the IR systems 
provide their indexing characteristic as part of the request for an electronic resource that 
is maintained by the server computer 110. 

The user database 228 stores information regarding each of the users that have 
requested access to one of the data objects 216A-216N and/or have a license to access 
the data objects 216A-216N. One embodiment of the user database 228 is described in 
further detail below with respect to Figure 4. 

The thesaurus module 232 defines for selected index words, a set of other related 
index words. Furthermore, the semantic network module 240 analyzes each of the data 
objects 216A-216N for their semantic meaning. The server computer 110 may 
optionally insert one or more index words that are provided by the thesaurus module 
232 and/or the semantic network module 240 into the index information of the source 
data object. 

The keyword extractor module 244 prepares an initial set of index words based 
upon the contents a selected one of the data objects 216A-216N. The keyword extractor 
module 244 determines whether any index information has already been prepared for 
the selected data object, or, alternatively, dynamically generates the index information 
for the selected data object. For example, if the selected data object is a music file, the 
keyword extractor module 244 can determine whether any index information is 
currently associated with the music file and/or scan the music to identify any words that 



216N. 



-14- 




are within the music. Furthermore, for example, if the selected data object is a bitmap 
image, the pattern recognition module 245 (Figure 3) can use optical character 
recognition (OCR) software so as to identify any words that are used within the bitmap 
image and use those identified words as the index information for the bitmap image. 
5 The main engine 204 also is connected to a stem list 238, a hit list 250, a drop 

list 260, a case list 264, and a stop list 268. The stem list 238 describes for one or more 
index words, a corresponding stem of the word. The server computer 110 may 
optionally reduce the overall size of the index information by substituting a stem of an 
index word for the index word. In one embodiment of the invention, the server 
10 computer 110 removes selected prefixes and/or suffixes fi-om the index words to create 
the stemmed words. For additional reference, information regarding stemming can be 
found in M. F. Porter, An Algorithm for Suffix Stripping, in Reading in Information 
:^ Retrieval (Morgan Kaufinarm, 1997). 

ffl The hit list 250 contains a list of words that are commonly used by users when 

:fl 15 searching the IR systems. In one embodiment of the invention, the hit list 250 is 

generated over time. In this embodiment, in each request for an electronic document, 
the client computer 115 provides to the server computer 110 a Ust of the keywords that 

ilJ 

□ were used by the user 102 when the user 102 searched for the source data object via one 

of the IR systems 208A-208M. For example, assuming the request is a HTML request 

20 which was prepared in response to a user selecting a "hit" that was displayed by one of 
the IR systems, the browser 120 automatically includes in the request the search terms 
that were used by the user 102 in generating the hit. The server computer 110 
accumulates and analyzes the keywords thereby identifying popular keywords which are 
used by users when searching for the data objects 216A-216N. 

25 Furthermore, in yet another embodiment of the invention, group hit lists (not 

shown) are maintained for groups of the data objects 112, each of the group hit lists 
describing popular words that were used by users to locate documents within the 
respective group. 

The drop list 260 includes a list of search words that are infi-equently or never 
30 used by users when users search for the data objects 216A-216N via the ER systems 
208A-208M. The server computer 110 may optionally remove one or more of the 
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words from the index information for a selected data object if the words are found in the 
drop list 260. 

The case list 264 includes a list of search words that have more than one 
associated spelling using different cases, eg-., IBM, ibm. If the requesting IR system is 
5 case sensitive, the server computer 110 can optionally add one or more words from the 
case list to the index information for the source data object. 

The stop list 268 includes a list of stop words which are removed from the index 
information for the source data object. The stop words are those words that should not 
be included in the index information because: (i) the words have special meaning to the 
10 IR system since they are part of a search grammar, (ii) the words occur so often that the 
words are considered to be of little relevance, and/or (iii) the provider of the data objects 
216A-216N has decided to remove the words from the index information for personal or 
business reasons, such as privacy. Figure 18 illustrates the contents of an exemplary 
stop list 268. 

15 Figure 4 is a high-level block diagram illustrating in ftirther detail some of the 

data items that are stored in the user database 228. In one embodiment of the invention, 
a record 308 is maintained for each of the users. The record 308 includes control rights 
312, a history log 316, and a user profile 320. The control rights 312 specify the rights 
of the user with respect to one or more of the data objects 216A-216N. In one 

20 embodiment if the invention, the control rights 312 specify the rights of the user with 

respect to a group of the data objects 216A-216N. 

The control rights 312 can include various items, such as: the right to print, 
copy, view, edit, execute, delete, and merge with another data object. Further, the 
control rights 312 can also specify a number of uses with respect to each of the control 

25 rights. For example, the control rights can specify that the user is allowed to print a 

selected one of the data objects such as data object 216B five times. In another 
embodiment of the invention, the control rights 312 may be applied to a group or all of 
the users. In another embodiment of the invention, the control rights may be integrated 
with one or more of the data objects 216A-216N. 

30 The history log 316 maintains a transaction history of each of the data objects 

216A-216N that have been requested by the user, as well as those search terms which 
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were used by the user to identify the data objects 216A-216N. In one embodiment of 
the invention, the history logs of each of the users are consolidated into a master history 
log 324. 

The user profile 320 includes information regarding the personal preferences of 
5 the user. For example, the user profile 320 can include one or more templates that are 

preferred by the user when viewing the data objects. Additionally, the user profile 320 
can include a national language that is preferred by the user, e.g., English, German, 
French, Swedish. 

10 Operation Flow 

Figure 5 is a high-level flowchart illustrating a process for generating an 
electronic document. After starting at a state 400, the process flow moves to a state 
404, wherein a requester requests an electronic document that is associated with a 
specified URL. In one embodiment of the invention, the network request for the 
15 electronic document is an HTTP request for an document that is associated with a 

selected URL. 

After receiving the network request fi"om either the user client computer 115 or 
one of the IR systems 208A-208M, the process proceeds to a state 408 wherein the 
server computer 110 dynamically generates an electronic document that provides index 
20 or other descriptive information regarding the source data object that is associated with 

the request, or, alternatively, retrieves the data object that is associated with the 
specified URL. 

The process for providing an electronic document or data object is described in 
further detail below with respect to Figure 6. However, in brief, the process is as 

25 follows. If the server computer 1 10 determines that the requester is authorized to access 

the data object that is associated with the specified URL, the server computer 110 
transmits the source data object that is associated with the request. However, if the 
requester is not authorized to access the data object, the server computer 1 10 generates a 
customized electronic document based upon whether the requester is one of the ER 

30 systems 208A-208M (Figure 2) or other type of user, such as the client computer 1 15 

(Figure 2). If the requester is one of the IR systems 208A-208M, the server computer 
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110 generates an electronic document that includes the index information for the source 
data object. 

If the requester is the client 115, the server computer 1 10 generates an electronic 
document that describes for the user the steps that the user must perform to obtain 
5 access to the source data object. After completing state 408, the process flow moves to 
an end state 412 wherein the server computer 110 waits for further document requests 
from the network 116. 

Figure 6 is a flowchart illustrating in further detail one embodiment of a process 
for providing a response to a request for an electronic resource that is maintained by the 

10 server computer 1 10. Figure 6 illustrates in further detail the acts that occur within state 

408 of Figure 5. It is noted that, depending on the embodiment, selected steps of Figure 
6 may be omitted and that other steps may be added. 

After starting at a start state 504, the process flow proceeds to a decision state 
506. At the decision state 506, the server computer 110 determines whether the 

15 requester of the data object is one of the IR systems 208A-208M or, alternatively, the 
client computer 115. To determine the identity of the requester, the server computer 
110 analyzes the electronic request (received in state 404 of Figure 5) for a requester 
identifier. The request identifier can be a unique value or a digital signature that is 
associated with the requester. 

20 If the server computer 110 determines that the requester is an IR system, the 

server computer 110 proceeds to a state 508 wherein the server computer 110 (Figure 2) 
determines whether all or selected portions of the source data object that is associated 
with the request should be converted into index information. If the server computer 1 10 
determines that selected portions of the data object should be converted into machine 

25 readable text, the server computer 1 10 proceeds to a state 512. 

At the state 512, the server computer 110 converts all or selected portions of the 
source data object that is associated with the request into machine readable characters, 
that will collectively comprise an initial set of index information for source data object. 
For example, if the source data object comprises a music file, the server computer 1 10 

30 may parse the music file to identify any words that are included within the lyrics of the 
music. As another example, if the source data object is a bitmap image, the server 

-18- 




computer 110 may employ character recognition to identify one or more textual 
elements within the bitmap image using optical character recognition software. 
Furthermore, if the source data object is a multimedia and/or a streaming media file, the 
server computer 110 may read and store any close captioned information that is 
5 associated with the file, or alternatively, employ one or more the above-described 

conversion techniques. Furthermore, if the source data object comprises text of another 
language, the server computer 110 can convert all or selected portions of the source data 
object into another language, such as English. 

In one embodiment of the invention, the server computer 110 maintains a list 

10 which describes one or more conversion processes to be employed with respect to the 
source data object. In another embodiment of the invention, the conversion information 
is predefined and stored within the source data object or at another known location. 

If at the decision state 508 the server 110 determines not to convert the source 
data object, or, altematively, after completing the state 512, the process proceeds to a 

15 state 514. At the state 514, the server computer 110 selects the index information for 

the source document. The index information can include the selected textual portions of 
the source data object, such as was converted at state 512, or altematively, portions of 
the source data object that is already in textual form. In one embodiment of the 
invention, the server computer 110 comprises predefined index information that is 

20 associated with the source data object. The predefined index information can be stored 
in one of several locations, including: a file on the server computer 110, a predefined 
section of the source data object, a predefined location on a remote computer, or a 
location on the network that is identified by the source data object. 

Continuing to a decision state 516, the server computer 110 (Figure 1) 

25 determines whether to create multiple electronic documents based upon the index 

information for the source data object. The provider of the data object may desire to 
export multiple electronic documents of index information, each of the electronic 
documents being directed to a selected portion of the data object. If the server computer 
110 determines that multiple documents are to be created, the server computer 110 

30 proceeds to a state 512. 
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At the state 518, the server computer 110 (Figure 1) partitions the index 
information into two or more sections. In one embodiment of the invention, the source 
data object includes its partition information. In another embodiment of the invention, 
the server computer 1 10 dynamically analyzes the source data object so as to identify 
one or more partitions. For example, if the source data object comprises a number of 
songs, the server computer 110 can partition the source data object based upon each of 
the songs. Furthermore, for example, with reference to Figure 8, if the source data 
object comprises an electronic book 600, the server computer 110 can partition the 
source data object into one or more sections 604, each of the sections being based upon 
one of the chapters of the book. To facilitate traversal the web documents by a spider, 
the server computer 1 1 0 may optionally include in the body of each of the electronic 
documents a link to one or more of the other partitions. 

If at the decision state 516, the server computer 110 determines not to create 
multiple documents of index information, or, alternatively, after completing state 518, 
process flow proceeds to a decision state 520. At the state 520, the server computer 110 
determines whether to obfuscate the index information. In one embodiment of the 
invention, each of the data objects 216A-216N (Figure 1) may designate whether the 
index information should be obfuscated. In another embodiment of the invention, a flag 
indicating whether the data object should be obfuscated is stored in a predefined 
location, such as on the server or another computer that is connected to the server via 
the network 116 (Figure 2). 

If the server computer 110 (Figure 2) decides to obfuscate the index information, 
the server computer 1 10 proceeds to a state 528. At the state 528, the server computer 
110 obfuscates the index information. The obfuscation process is described in further 
detail below with reference to Figure 10. However, in brief, the obfuscation process 
modifies the index information such that if the index information was viewed by a user, 
the user would not be able to easily reconstruct the original content of the source data 
object. 

Referring again to the decision state 520, if the index information is already 
obfuscated or if obfuscation is not desired, or, after completion of the state 528, the 
server computer 1 10 proceeds to a state 532. At the state 532, the server computer 1 10 
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dynamically generates a header and body for an electronic document using the prepared 
index information. The process for dynamically generating the electronic document is 
described in further detail below with reference to Figure 1 1 . 

The server computer 110 then proceeds to an end state 536 waiting for 
5 additional electronic resource requests. Once the request is received, the process flow 

starts again at the state 400 (Figure 5). 

Referring again to the decision state 506, if the server computer 110 (Figure 1) 
determines that the requester is the user 102 (Figure 1), the server computer 110 
proceeds to a decision state 540. At the decision state 540, the server computer 110 

10 determines whether the user 102 is authorized to access the source data object that is 

associated with the requested electronic resource. In one embodiment of the invention, 
the server computer 110 identifies the identity of the user by examining the user 
information that was provided by the cUent computer 115 as part of the request for the 
electronic resources. For example, in a HTTP request, user authentication can be 

15 performed using HTTP Authentication, e.g. RFC 2617 as is described at 

<http://www.ietf org/rfc/rfc2617.txt>. The server computer 110 may also optionally 
display an authorization screen wherein the user 102 is requested to provide identifying 
information, password, or digital signature. Upon identifying the identity of the user 
102, the server computer 110 examines the control rights 312 (Figure 3) that are 

20 associated with the user to determine the access rights of the user 102. In another 

embodiment of the invention, the server computer 110 displays a description of the 
source data object and a hyperlink to an authentication server (not shown). If the user 
selects the hyperlink, the authentication server determines whether the user is allowed 
access to the source data object. 

25 If the server computer 110 (Figure 1) determines that the user 102 is authorized 

to access the data object, the server computer 1 10 proceeds to a state 544. At the state 
544, the server 110 checks the format templates module 266 to see if the source data 
object has an associated format template. If the source data object has an associated 
format template, the server computer 110 formats the source data object according to 

30 the specifications of the associated format template. The server 110 then transmits the 

source data object to the client computer 115. If the source data object is a streaming 
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media file, the server computer 110 streams the content of the data object to the client 
computer 115 (Figure 1). 

Continuing to a state 548, the server computer 110 stores one or more items of 
user information. For example, the user information can include: the name of the user 
5 102, an identifier that is associated with the user, the time the data object was 

transmitted to the user, and one or more search words that were used by the user 102 to 
locate the electronic resource. Next, the server computer 1 10 moves to the end state 536 
and waits for additional electronic resource requests. 

Referring again to the decision state 540, the if the server computer 110 (Figure 

10 1) determines that the user 102 (Figure 1) is not authorized to access the source data 

object, the server computer 110 proceeds to a state 700 (Figure 7) via off page 
connector "A." At the state 700, the server computer 110 generates an electronic 
document that will describe to the user 102 what steps the user 102 should take to 
become authorized to access the source data object. At the state 700, the server 

15 computer 110 generates a header and body for the electronic document. 

With respect to Figure 9, an illustrative electronic document 900 is shown that 
includes a brief description 904 of the source data object, payment information 908 for 
the source data object, and an acceptance selector 916. The acceptance selection is an 
icon, such as a button, whereby selecting the user can indicate approval and acceptance 

20 of the conditions of the payment information 908. 

Continuing to a decision state 704, the server computer 110 determines whether 
the user 102 agrees to the conditions of access that were specified in the electronic 
document (prepared in state 700). If the user 102 (Figure 1) agrees to the access 
conditions, the server computer 110 proceeds to the state 544 (Figure 6) via off page 

25 connector "B." State 544 is described in further detail above. However, if the user 

102 does not agree to the access condition, the server computer 110 proceeds to the state 
548 (Figure 6) via off page connector "C." State 548 is described in fiirther detail 
above. 

It is noted that in one embodiment of the invention, one or more of the states 
30 shown in Figiu^es 6 and 7 can occur in a pre-processing stage prior to receiving requests 

for the electronic resource fi-om the client computer 1 15 or one of the IR systems 208 A- 
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208M. For example, data object conversion (state 512), index information partitioning 
(state 520), index information obfuscation (state 528), generation of electronic 
documents (states 532 and 700) can occur, if desired, prior to receiving a request for one 
of the data objects 216A-216N. 
5 Figure 10 is a high level flowchart illustrating a process of obfuscating index 

information. Figure 10 illustrates in further detail the state 528 of Figure 6. In one 
embodiment of the invention, prior to traversing the states of Figure 10, the server 
computer 110 has received a request for an electronic resource at a selected URL. 
Furthermore, the server computer 110 has identified a source data object that is 

10 associated with the selected URL, and the server computer 110 has prepared a putative 
set of index information for the source data object. The putative set of index 
information may have come from one of the data objects 216A-216N, an indexing file 
that is associated with the source data object, or some other source. The obfuscating 
process transforms the index information in such a way as to obscure or confuse the 

15 meaning of the information without interfering with the ability of an IR system to 

properly index and retrieve the electronic document. 

After starting at a state 1000, the server computer 110 (Figure 1) proceeds to a 
state 1004 wherein the server computer 110 parses the content of the index information. 
At the state 1004, the server computer 110 "tokenizes" via a tokenizer each of the words 

20 in the index information. Tokenizing refers to separating the index information into 
groups of words, "tokens," based upon a delimiter which depends upon the indexing 
characteristics of the requesting IR system. The delimiter can include white space, e.g., 
a space, a carriage return, or a tab, or, alternatively, can be a word from the stop list 268 
(Figure 2). If the requesting IR system recognizes phrases (as indicated by the 

25 information retrieval database 224), the server computer 110 parses the index 

information based upon the words in the stop list 268, thereby creating a plurality of 
tokens, each of the tokens having one or more words. Otherwise, if the requesting IR 
system does not recognize phrases, the server computer 110 parses the index 
information based upon white space that is within the index information. 

30 Continuing to a state 1008, the server computer 110 removes selected tokens 

from the index information. In one embodiment of the invention, the server computer 
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no removes from the index information each of the tokens that are Hsted within the 
stop Hst 268. 

For example. Figure 13 illustrates an exemplary data object 1300, wherein the 
data object comprises an HTML document. Assuming that the contents of the 
5 exemplary data object 1300 comprised the putative set of index information, after 
completing the state 1008, as is shown in Figure 13, the server computer 110 has 
removed one or more of the tokens that are listed within the stop list 268. Figure 14 
illustrates an exemplary set of tokens that remain after the server computer 110 has 
removed selected tokens from the exemplary data shown in Figure 13. 

10 Moving to a state 1012 (Figure 10), the server computer 1100 may optionally 

insert one or more selected tokens into the index information. In one embodiment of the 
invention, the server computer 110 replaces one or more of the tokens that were 
discarded in state 1008 with a randomly selected token from the stop list. 268. The 
server computer 110 may optionally elect to insert random tokens from the stop list 268 

15 even though no words were discarded from step 1008. Continuing the example from 

above, Figure 15 illustrates the contents of the index information shown in Figure 14 
after selected tokens have been added to the index information. 

Next, at a state 1016, the server computer 110 optionally randomizes via a 
randomizer the order of each of adjacent tokens. The tokens are randomized by 

20 selecting a predetermined number of tokens from the output of the previous steps (in the 

order they were parsed), and then randomizing the order of those tokens. The number 
of tokens that is gathered in each pass is known as the randomness factor. The greater 
the value of the randomness, the greater is the impact on IR systems that evaluate the 
proximity of words. If the server computer 110 uses a stop list 268 that has a large 

25 number of tokens, the index information may be adequately obfiiscated by the removal 

of the words that are in the stop list 268 and the randomization step may be omitted. 

Still referring to the state 1016, in another embodiment of the invention, the 
order of the tokens is reversed via a token order reverser. If the order of the tokens is 
reversed, the index information will be slightly more obfiiscated that otherwise; 

30 however this reversal may reduce the recall and precision of IR systems that consider 
word order. Figure 16 illustrates the contents of the index information after the contents 
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of the index information shown in Figure 15 has been randomized. Next, at a state 
1020, the obfuscation process ends. 

Figures 11 and 12 are collectively a flowchart illustrating a process of 
dynamically customizing the index information for the source data object. Figures 11 
5 and 12 further illustrate the states that are within state 532 of Figure 6. In one 

embodiment, prior to entering the states shown in Figures 11 and 12, the server 
computer 110 has determined that it has received a request for an electronic resource at 
a selected URL from one of the IR systems 208A-208M. In another embodiment, the 
server computer 110 is preprocessing a selected, data object and, is customizing the 

10 index information in preparation of a future request. Furthermore, the server computer 
110 has prepared a putative set of index information that may optionally be obfuscated 
by the process shown in Figure 10. 

After starting at a start state 1 100, the server computer 110 (Figure 1) proceeds 
to a state 1104. At the state 1104, the server computer 110 (Figure 1) dynamically 

15 generates an initial header and body for the requested electronic document based upon 

the contents of the putative set of index information. In one embodiment of the 
invention, the header and the body of the electronic document comprises each of the 
words in the putative set of index information. For example, assuming the electronic 
document is an HTML document, the server computer 110 can insert each of the words 

20 in the putative set of index information into the keywords section of the header. The 
server computer 110 inserts the command <META Name="keywords" Content- 'ATey 
Word List'>, wherein Key Word List is a list of each of the words, into the header 
portion of the electronic document. Furthermore, the server computer 110 can 
optionally insert one or more words in the "description" section of the header. In 

25 HTML, the description metatag allows ER systems to display an intelligible excerpt 

regarding the content of the document beneath the title of the electronic document. The 
server computer 1 10 may optionally insert one or more words from the putative set of 
index information and/or a description that is associated with the data object in the body 
of the electronic document. Optionally, depending on the indexing characteristics of the 

30 requesting IR System, if index information is to be included in the body of the 
electronic document, the server computer 110 can set the font of the text within the 
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body portion to be displayed using a white font on and white background to provide a 
more user-friendly display to the electronic document. However, if the requesting IR 
system ignores text having a font color that is the same as the background, the server 
computer 110 does not employ this technique. 
5 Moving to a decision state 1 112, the server computer 110 determines whether to 

perform "stemming" with respect to the index information. Stemming refers to the 
process of truncating one or more of the words comprise the index information, hi one 
embodiment of the invention, the determination of whether to perform stemming is 
based upon the indexing characteristics of the requesting IR system. It is noted that for 

10 some electronic document formats, the header portion of the electronic documents can 
only store a selected amount of characters. Furthermore, some IR systems only analyze 
a selected portion of the header, e.g., the first 100 characters in the index information 
portion of the header. For these electronic document formats and IR systems, the server 
computer 110 advantageously attempts to maximize the number of index words that are 

15 included within the header. By stemming one or more of the index words that are 

within the header, the server computer 1 10 reduces the total character count of the index 
words, thereby leaving space for one or more index words to be added to the header of 
the electronic document. 

If the server computer 110 (Figure 1) determines to perform stemming, the 

20 server computer 1 10 proceeds to a state 1116. At the state 1116, the server computer 
110 stems the words in the index information. In one embodiment of the invention, the 
server computer 110 substitutes one or more words from the index information with a 
corresponding word from the stem list 238. In another embodiment of the invention, 
the server computer 110 removes selected prefixes and/or suffixes from the index words 

25 to create the stemmed words. 

Referring again to the decision state 1112, if the server computer 110 (Figure 1) 
determines not to perform stemming, or, alternatively, from the state 1116, the server 
computer 1 10 proceeds to a decision state 1 120. At the state 1 120, the server computer 
110 determines whether to insert one or more words into the header and/or body of the 

30 electronic document using words from the case hst 264. In one embodiment of the 
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invention, the determination whether to insert one or more words from the case hst 264 
is based upon the indexing characteristics of the requesting IR system. 

If the server computer 110 determines to add or more words from the case list 
264, the server computer 110 proceeds to a state 1124. At the state 1124, the server 
computer 110 reads the case Hst 264. Continuing to a decision state 1128, the server 
computer 110 determines whether one or more words in the case list 264 are also 
included within the electronic document. If the server computer 110 identifies one or 
more words in the case list 264 that are also in the electronic document, the server 
computer 110 proceeds to a state 1 132. At the state 1 132, the server inserts one or more 
words from the case list 264 into the electronic document. 

If at the decision state 1120 the server computer 110 determines not to add or 
more words from the case list 264, or, if at the decision state 1128 no words were 
identified in the electronic document that were in the case list 264, or after completing 
the state 1 132, the server computer 110 proceeds to a decision state 1 136. 

At the decision state 1136, the server computer 110 determines whether to 
remove a selected classification of words. The selected classification can include 
duplicative words, adjectives, adverbs, nouns, pronouns, or verbs. In one embodiment 
of the invention, the determination whether to remove a selected classification of words 
is based upon the indexing characteristics of the requesting IR system. In another 
embodiment of the invention, the determination whether to remove a selected 
classification of words is based upon the preference of the provider of the source data 
object. It is noted that more than one classification of words may be removed. 

For example, if the requesting IR system does not place additional weight on 
index words that are duplicative, the server computer 110 can decide to remove the 
duplicative word to make space in the index information for other non duplicative 
words. Furthermore, for example, the server computer 1 10 can remove adjectives from 
the index information to increase the obfiiscation of the index information and to also 
increase space in the index information for other potentially more meaningfiil index 
information. 
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If the server computer 110 determines to remove a selected classification of 
words, the server computer 110 proceeds to a state 1 140. At the state 1 140, the server 
computer 110 removes the selected classification of words from the index information. 
Referring again to the decision state 1136, if the server computer 110 (Figure 1) 
5 determines not to remove a classification of words, or, alternatively, after completing 

the state 1140, the server computer 110 proceeds to a decision state 1144. At the 
decision state 1144, the server computer 110 determines whether to add one or more 
words to the electronic document that are common to a group of documents. The server 
computer 110 may determine that even though a word was not one of the words of the 

10 source data object (and therefor not one of current index words in the electronic 
document), the word should be added since it is found in one or more data objects that 
are related to the source data object. If the server computer 110 determines to add one 
or more of the common words, the server computer 1 10 proceeds to a state 1 148. At the 
state 1148, the server computer 110 inserts one or more of the common words into the 

1 5 electronic document. 

Referring again to the decision state 1 144, if the server computer 110 (Figure 1) 
determines not to add conmion words to the electronic document, or alternatively, after 
completing the state 1 148, the server computer 110 proceeds to a state 1208 (Figure 12) 
via off page connector "D." At the state 1208, the server computer 110 determines 

20 whether to add one or more words from the thesaurus module 232 (Figure 3). 

If the server computer 110 determines to add or more words from the thesaurus 
232, the server computer 110 proceeds to a state 1212. At the state 1212 the server 
computer 110 identifies one or more words from the thesaurus 232 that have a similar 
meaning to one or more of the index words into the electronic document. In one 

25 embodiment of the invention, the server computer 110 checks the thesaurus module 232 
for each of the words that are within the electronic document. In another embodiment 
of the invention, the server computer 110 only checks the thesaurus module 232 for 
words that are found multiple times within the index information. In yet another 
embodiment of the invention, the server computer 110 only checks the thesaurus 

30 module 232 for the words that were added in the state 1 148. In yet another embodiment 
of the invention, the server computer 110 checks the thesaurus module 232 for those 
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words that were removed at the state 1 140. After identifying one or more related words 
via the thesaurus module 232, the server 110 inserts the identified words into the 
electronic document. 

If the server computer 1 10 (Figure 1) determines not to add or more words fi'om 
5 the thesaurus module 232, or alternatively, after completing the state 1212, the server 

computer 110 proceeds to a decision state 1216. At the decision state 1216, the server 
computer 1 10 determines whether to add or more words fi-om any hit lists, such as the 
hit list 250 (Figure 3), that may be associated with the data object. The server computer 
110 can determine whether to apply a hit list on a data object-by-data object basis, or 

1 0 altematively, on a group-by-group of data objects basis. 

If the server computer 110 determines to add one or more words firom the hit list 
250, the server computer 110 proceeds to a state 1218. At the state 1218, the server 
computer 110 adds one or more words from the hit list 250. 

Referring again to the decision state 1216, if the server computer 110 determines 

15 not to add words from the hit, or altematively, after completing the state 1218, the 
server computer 110 proceeds to a decision state 1220. 

At the decision state 1220, the server computer 110 determines whether to 
remove one or more words from the index information that are identified by the drop 
list 260 (Figure 3). If the server computer 110 determines to remove one or more words 

20 from the drop list 260, the server computer proceeds to a state 1224. At the state 1224, 

the server computer 110 removes one or more words from the index information that are 
found in the drop list. 

Referring again to the decision state 1220, if the server computer 110 (Figure 1) 
determines not to remove one or words from the drop list 260, or, altematively, after 

25 completing the state 1224, the server proceeds to a decision state 1228. At the state 

1228, the server computer 110 determines whether the semantic network module 220 
(Figure 3) is enabled. If the semantic network module 220 is enabled, the server 220 
proceeds to a state 1232 and adds one or more words that have been identified by the 
semantic network to the index information. 

30 Referring again to the decision state 1228, if the semantic network module 220 

(Figure 3) is not enabled, or, altematively, after completing state 1232, the server 
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computer 110 (Figure 1) proceeds to a state 1236. At the decision state 1236, if the 
number of words in the index information is greater than the number of words that are 
used by the requesting IR system, the server computer 110 applies a selection function 
to remove one or more words from the index information. In one embodiment of the 
5 invention, the server computer 110 prioritizes and maintains in the index those words 

that occur with a high frequency in a high number of documents. It is noted that the 
selection function of state 1236 may optionally be applied after the server computer 1 10 
executes after any of the states 1116, 1132, 1140, 1148, 1212, 1218, or 1224. 
Continuing to an end state 1244, the server computer 110 proceeds to an end state 1248. 

10 The present system provides a cost effective solution to providing index 

information to IR systems. The system does not require any changes on the part of the 
IR system providers. DRM-protected data objects can be used with the IR systems as if 
the DRM-protected data objects are not rights-protected at all. The system permits 
seamless, nearly transparent, and immediate support for searching of DRM-protected 

15 data objects, while allowing the DRM software to remain in exclusive control over the 
DRM data objects. 

Furthermore, one embodiment of the present invention (Figure 1) reduces the 
overhead that is associated with maintaining index information for various 
heterogeneous IR systems. The server computer 110 can generate customized index 

20 information on the fly based upon the indexing characteristics of the IR system. 

Furthermore, if the content of the data objects 216A-216N changes, the server computer 
110 can automatically generate new index information for the data object. 

While the above detailed description has shown, described, and pointed out 
novel features of the invention as applied to various embodiments, it will be understood 

25 that various omissions, substitutions, and changes in the form and details of the device 

or process illustrated may be made by those skilled in the art without departing from the 
spirit of the invention. The scope of the invention is indicated by the appended claims 
rather than by the foregoing description. All changes which come within the meaning 
and range of equivalency of the claims are to be embraced within their scope. 
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